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Abstract 

Among their many uses, growth processes (probabilistic amplification), were used for constructing 
reliable networks from unreliable components, and deriving complexity bounds of various classes of 
functions. Hence, determining the initial conditions for such processes is an important and challenging 
problem. In this paper we characterize growth processes by their initial conditions and derive conditions 
under which results such as Valiant' s| Val84| hold. First, we completely characterize growth processes 
that use linear connectives. Second, by extending Savicky's | Sa v90l analysis, via "Restriction Lemmas", 
we characterize growth processes that use monotone connectives, and show that our technique is appli- 
cable to growth processes that use other connectives as well. Additionally, we obtain explicit bounds 
on the convergence rates of several growth processes, including the growth process studied by Savicky 
(1990). 

Keywords: Computational and structural complexity, growth processes, probabilistic amplification 

1 Introduction 

The notion of a random Boolean function occurs many times, both implicitly and explicitly, in the litera- 
ture of theoretical computer science. Not long after Shannon |Sha38] pointed out the relevance of Boolean 
algebra to the design of switching circuits, Riordan and Shannon |RS42| obtained a lower bound to the 
complexity (the size of series-parallel relay circuits, or of formulas with the connectives "and", "or" and 
"not") of "almost all" Boolean functions, and this bound can naturally be applied to a "random" Boolean 
function when all 2^" Boolean functions of n arguments are assumed to occur with equal probability. Lu- 
panov PLup611 later showed that Riordan and Shannon's lower bound is matched asymptotically by an upper 
bound that applies to all Boolean functions, so in this situation the average case is asymptotically equivalent 
to the worst case. This asymptotic equivalence of average and worst cases also holds in many other situa- 
tions involving circuits or formulas. There are some complexity measures, however, such as the length of 
the shortest disjunctive-normal-form formula, for which the average case behaves quite differently from the 
worst case (see Glagolev [Gla67J, for example), and the complexity of a random Boolean function remains a 
challenging open problem. In these cases, probability distributions other than the uniform distribution have 
also been considered; for example, one may assume that each entry in the truth-table is independently 1 with 
probability p and with probability 1 — p, so that the uniform distribution is the special case p = 1/2 (see 
Andreev LAnd84J ). 
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Another approach to the study of random Boolean functions is to put a probability distribution on for- 
mulas, and let that induce a probability distribution on the functions that they compute. This may be done 
by using a "growth process" (defined below) to grow random formulas. 

Valiant | Val84| considered such a growth process, and showed that the resulting probability distribution 
tends to the distribution concentrated on a single function: the threshold function that assumes the value 

1 if and only at least n/2 of its n arguments assume the value 1. This result was used to obtain a non- 
constructive upper bound on the minimum possible size of a formula for computing this threshold function. 
This argument in fact gives the best upper bound currently known for this and similar threshold functions. 

The choice of the initial probability distribution on formulas dictates the probability distribution on 
functions. To facilitate the design and use of growth process, as in the case above, deriving a characterization 
based on the initial conditions is an important problem. 

One such result in this framework is due to Savicky |Sav90|. Savicky formulated broad conditions 
under which the distribution of the random function computed by a formula of depth i tends to the uniform 
distribution on all Boolean functions of n variables as z ^ oo. 

Savicky pSav95a| has also shown that in some cases the rate of approach of the probability of computing 
a particular function / to the uniform probability 2~^" gives information about /: it is fastest for the linear 
functions, and slowest for the "bent" functions (which are furthest, in Hamming distance, from the linear 
functions). For some other models of random formulas, Lefmann and Savicky |LS97 | and Savicky fSav981 
have shown that the logarithm of the probability of computing a particular function is related to the com- 
plexity of that function (as measured by the size of the smallest formula computing that function). Finally, 
we should mention that Razborov IRaz88l has used random formulas in yet another model to show that 
some large graphs with Ramsey properties have representations by formulas of exponentially smaller size. 
This result, which has been improved quantitatively by Savicky [iSav95b |, shows that Ramsey properties are 
possessed by graphs that are far from random. 

Our goal in this paper is to determine under what circumstances results like Valiant's and Savicky's 
hold. We show that for many growth processes, the probability distribution on the computed function tends 
to the uniform distribution on some set of functions (which may range in size from a single function, as in 
Valiant's result, to all functions, as in Savicky's). 

2 Definitions 

Let Tn denote the family of n-adic Boolean functions, let A4n denote the family of n-adic monotone 
Boolean functions, and let Cn denote the family of n-adic linear functions. The set Bn denotes Boolean 
cube of size n. 

Let k be a. positive integer and a be a fc-adic Boolean function, which we call the connective. Let 
^0 = {^1,^2, Xn, xi, x„, 0, 1} be the set comprising the projection functions, their negations, and 
the constant functions, and let Ai = {a{vi,V2, ■■■,Vk) \ Vi € ^i-i} be the set comprising the formulas 
composed from Ai^i. A growth process is denoted by a pair (/i, a), where is a distribution on and a 
is a connective; ji is called the initial distribution. A growth process gives rise to a probability distribution 
TTi on Ai for each i > in the following way. We take ttq = /i. For i > 1, we take vrj(/) to be the probability 
that a{gi, . . . ,gk) = /, where gi,. ■ ■ ,gk are independent random functions distributed according to 7r,;_i 
on 

We shall assume that /i is a uniform distribution on a subset of Aq. This subset will always contain the 
n projections; it may or may not contain their n negations; and it may contain neither, one, or both of the 
two constants. All of our results could be extended to more general distributions fi, but these assumptions 
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allow us to present the most interesting results with a minimum of notation. They also cover the results of 
Valiant IIVal84 l and Savicky fSav90 |. (Valiant's proof actually uses a non-uniform distribution, but the same 
bound can be obtained by a simple modification using a uniform distribution on the projections.) 

The support of a probability distribution vr, denoted supp{7r), is the set {/ | 7r(/) > 0}. The support 
of a growth process is the set of all functions for which vrj(/) > for some i > 0: UiSupp{'Ki). 

We are particularly interested in cases in which vrj tends to a limiting distribution vr as i ^ oo. (There 
are also cases in which TT2i and TT2i+i tend to distinct alternating limiting distributions.) When a limiting 
distribution exists, we can have vr(/) > only for / in the support of the growth process. As Valiant's 
result indicates, however, there may be functions in the support for which TTi{f ) 0, so that vr(/) = 0. 
The asymptotic support of a growth process with a limiting distribution vr is the set of functions f G J^n 
for which vr(/) > 0. 

Additionally, we investigate how quickly the distribution vTj approaches the limiting distribution as i 
approaches infinity. Namely, for some e > 0, the size of i such that maxj jvr(/) — vrj(/)| < e. Al- 
most all growth processes that we study share the important characteristic: for any e > 0, maxj |7r(/) — 
^0{iog{n)){f)\ < £■ Note, unless otherwise stated, the base of the logarithm is assumed to be 2. 

Growth processes in which the limiting distribution is concentrated on one function are used extensively 
in probabilistic amplification methods and can be analyzed by studying the properties of the corresponding 
"characteristic polynomial". Let {Xi,X2, X^} be a set of random independent binary variables that are 
1 with probability p and let each Xi represent the input Xj. The characteristic polynomial of / is defined 
by Afip) = Fr[f{Xi,X2,...Xn) = 1] and is given by 

Af{p) = f;^pJ%\l-pr-' 

where /3j is the fraction of assignments of weight i for which / is true. The characteristic polynomial 
was used by von Neumann lvN56 1 and by Moore and Shannon [MS56| to study reliable computation with 
unreliable components, as well as by Valiant IVal84l (see also Boppana |Bop85 Bop89 DZ97 1). 

To analyze growth processes whose limiting distribution is uniform over a set of functions, we use a 
Fourier transform technique. The Fourier transform Aj of a probability distribution vTj is defined by 

^'(/) = E (1) 

where TTi{g) is the probability of selecting g from Ai. For convenience, the inner product {f,g) = J2i fi9i 
is defined to be over the integers, rather than over Z2. Unless otherwise noted. Boolean n-adic functions are 
represented as Boolean vectors from i?2"- The inverse Fourier transform is defined by 

^^i9) = ^ E (-1)<^''^A.(/)- (2) 

The Fourier transform was used by Razborov IRaz88ll to derive his results on Ramsey graphs, as well as by 
Savicky IISav90l . 

The Fourier transform plays a role in many of our results, but it needs to be adapted in various ways 
to suit different cases. When dealing with linear functions, for example, we will have to represent the 
functions / and g in definition ^ not as Savicky does, by their truth-tables, but rather by their coefficients 
as multivariate polynomials over GF{2). In other cases, when establishing a limiting distribution that is 
uniform over a proper subset of JF„, we shall need to use what we call "restriction lemmas", which assert 
relationships that hold among the values of the Fourier transform. 
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3 Growing Linear Functions 



A function / is linear if it is of the form f{xi, . . . , Xn) = cq © cixi © • • • © CnXn for some constants 
Co, ci, . . . , G GF{2). We may assume without loss of generality that a depends on all its arguments, so 
that a{yi, . . . , yu) = c © yi © • • • © y^, where k > 2. The result of the growth process depends on the 
support of of the initial distribution /i, the parity of k, and the constant term c. 

To prove this we derive a recurrence for the Fourier coefficients of the respective probability distribution 
TTj, from which we derive the limiting distribution. Since compositions of linear functions are themselves 
linear, we represent the linear functions by their vector (cq, ci, . . . , c„) of coefficients, and the following 
summations range over £„. Finally, let wi denote the constant function 1 (wi = 100 ... 0), whereas 1 = 
11... 1. 

Proposition 3.1 Let a be a linear connective as described above and let w G £„. The Fourier coefficients of 
the probability distribution VFj of the corresponding growth process are described by the recurrence relation 

Ai+i(u;) = (-l)'=<-i'-)Ai(w;)^ 

Proof: 

k 

k k 

= (-l)<^'^i'"'>Ai(u')'= 



Using proposition 13. II the following theorems classify the growth processes on Unear connectives. 

Theorem 3.2 Let a{y) = c © yi © ■ ■ ■ © y^. > 1, be a linear k-adic connective, as defined above, and 
assume that the support of fi does not contain negations of the projections. 

L If {0, 1} n supp{p,) 7^ {0, 1}, k is odd and c = 1, then the growth process has alternating limiting 
distributions, each of which is uniform over one half of the support of the growth process ( which 
consists of all linear functions for which ©j=i Cj = 1). 

2. In all other cases, the limiting distribution is uniform over the support of the growth process ( which 
depends on k, c, and the presence of constants in the support). 

Proof: Two facts are key to this theorem: first, that \Ai{w)\ < 1, and second, that if |Aj(t(;)| < 1, 
then limj^oo \ = 0. Only the nonzero (magnitude 1) coefficients contribute to limiting distribution 
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(equation |2li; fortunately, these are determined solely by the support of the initial distribution. Depending 
on which constants are part of the support, there are either one, two, or four magnitude 1 coefficients: 

{0,1} nsupp{fi) = {0,1} ^ Ao(0) = l, 

{0,l}nsupp{fi) = {0} ^ Ao(0) = Ao(«;i) = 1, 

{0,l}nsupp{fi) = {l} Ao(0) = 1, Ao(l) = -1, 

{0,1} n suppip) = (I) ^ Ao(0) = Ao(u;i) = 1, Ao(l) = Ao(u;i e 1) = -1. 

If k is odd and c = 1, the recurrence from Proposition 13. 1 1 implies that Ai^i{wi) = —Ai{wi) and 
Ai+i(l) = — Aj(l). Hence, if supp{fi) fl {0, 1} ^ {0, 1}, the resulting distribution is alternating. In the 
case where one of the constants is missing from the support, only two coefficients have magnitude 1, and 
thus, the alternating distributions are each uniform over half of £„. In the case where both constants are 
missing, the alternating distributions are each uniform over one quarter of 

If c = 0, A; is even, or {0, 1} fl supp{ii) = {0, 1}, the limiting distribution exists because the sign of 
the magnitude 1 coefficients does not alternate. We can read off the limiting distribution from the Fourier 
coefficients. If both constants are in the support, then the limiting distribution is uniform over If only 
one of the constants is present, then the distribution is uniform over half of Cn, and if neither is present, then 
the distribution will be uniform over a quarter of ■ 

If the support of /i contains negations, then using the same proof technique yields the following theorem. 

Theorem 3.3 Let a{y) = c ® yi ® ■ ■ ■ ® yk be a linear k-adic connective, as defined above, and assume 
that the support of ii contains negations of the projections. 

1. If {0, 1} n supp{^) = and k is odd then the limiting distribution is uniform over all linear functions 
of odd number of variables. 

2. If {0, 1} n supp (fl) = and k is even then the limiting distribution is uniform over all linear functions 
of even number of variables. 

3. Otherwise, the limiting distribution is uniform over all of Hn- 

Proof: If {0, 1} n supp{ii) ^ 0, then there is only one coefficient of magnitude 1, Ao(0) = 1, implying 
the last case. 

Otherwise, there is one other magnitude 1 coefficient, Ao(l © w\) = —1. If k is odd, then Aj_|_i(l © 
w\) = Aj(l © wi)^ = —1, implying the first case of the theorem. If k is even, then Aj+i(l © wi) = 
Ai{l (£) wi)'' = 1, implying the second case. ■ 

Note, that if negations are present, no alternating distribution can occur. To bound the convergence of 
TTj to vr we use the inverse Fourier transform. 

Theorem 3.4 Let a be a k-adic linear connective, k > 1, of a linear process on n variables that has a 
limiting distribution vr. Ifi > ^r^j^, then for any linear function f, |vr(/) — vrj(/)| < 2^". 
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Proof: Let D = {w : \Aq{w)\ < 1}, then vrj(/) may be written as: 

weBn + l 

= vr(/) + 2~"-i^ A,M. 

Thus, for any hnear function /, 

k(/) - = |2-"-' (-l)^"''^^ A,(/)| < max |AoM|'=' < (1 - ■ 

Solving inequality (1 — n^^)'^' < 2^"', in terms of i, yields: i > "^logik) ■ ■ 

4 Growing Self-Dual Functions 

Savicky fSavQOl showed that if the connective is balanced (that is, if it assumes the value 1 for just one-half 
of the combinations of argument values) and non-linear, and the support of is all of Aq, then the limiting 
distribution will be uniform over all of If we remove the constants from the support of fi and assume 
the connective a is self-dual (that is, satisfies a{yi, . . . y^) = a(yi, • • • , yfc)), then the support of the growth 
process is the set of all self-dual functions. In this case the limiting distribution of the growth process is 
uniform over this support. 

Theorem 4.1 If the connective is non-linear and self-dual, and the support of comprises the projections 
and their negations, then the limiting distribution will be uniform over the family of self-dual n-adic func- 
tions. 

Proof: Observe that there is a bijection between the set of all functions on n variables and the set of self-dual 
functions on n + 1 variables, for example, the map 

f{xi,X2, ...,Xn)^ f{xi,X2, • • • , Xn)Xn+l V /(xq, Xi, . . . , Xn)Xn+l. 

The result follows. ■ 

5 Growing Monotone Functions 

We now focus on growth processes that use monotone connectives. For the rest of this section we assume 
that a is monotone and the support of fj, contains only monotone functions from Aq (that is, projections and 
possibly constants). We first investigate unbalanced connectives. 

5.1 Using Unbalanced Connectives 

Growth processes that use unbalanced monotone connectives concentrate probability on a threshold func- 
tion; the type of threshold function depends on the connective and the support. A threshold function 
Tk{xi, . . . ,Xn) assumes the value 1 if and only if at least k of its n arguments assume the value 1. We 
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consider constant functions Tn+i = and Tq = 1 to be special cases of threshold functions. There are 
two cases to consider: first, when the characteristic polynomial of a, Aa{p), has no fixed-point on the open 
interval (0, 1), and second, when Aa{p) has a fixed-point on (0, 1). 

Proposition 5.1 If a is a monotone connective whose characteristic polynomial, A{p), has no fixed-point 
on the interval (0, 1), then the limiting distribution will be concentrated on a threshold fiinction. 

Proof: Since A{p) has no fixed-point on (0,1), either Aa{p) < p throughout (0,1), or Aa{p) > p 
throughout (0,1). If Aa{p) > p throughout (0,1), then by the standard amplification argument, the limiting 
distribution is concentrated on Ti (disjunction of all variables) or, Tq if 1 is in the support of fi. Similarly, 
if Aa{p) < p throughout (0,1), then the limiting distribution is concentrated on T„ (conjunction of all 
variables) or Tn+i if is in the support of fi. m 

Furthermore, all connectives whose characteristic polynomials have no fixed-point on (0, 1), are either 
of the form a{x) = Xj V a'{x) (when Aa{p) > p) or a{x) = Xj A a'{x) (when Aaip) < p). If a{x) ^ 
Xi V a'{x), then Aq,(p) = 0{p'^) which implies that there exists a positive constant eq such that for all 
< e < eo, Aa{e) < e. Similarly, if a{x) / A a'{x), then by duaUty, 1 — ^4^(1 — p) = 0{p'^), which 
means that Aa{l — e) > 1 — e for all < e < ei for some ei > 0. Since Aa{p) is continuous, there must 
exist a fixed-point in (0, 1), which is a contradiction. 

In the second case, where Aa{p) has a fixed-point in (0, 1), Moore and Shannon fMS56| have shown 
that this fixed-point is unique. Not surprisingly, the limiting distribution depends on the fixed-point. Thus, 
we first derive two facts about the fixed-point of the characteristic polynomial, to deal with the second case. 

Lemma 5.2 The characteristic polynomial A{p) has a fixed-point of ^ if and only if the connective a is 
balanced. 

Proof: By definition Yl^=o "^^e number of assignments for which a is true. If j4q,(^) = |, then 

Aaih) = EtoAiDihYihr-' = 2^Er=oA(-) = -2- Hence, Er=oA(-) = 2""^ which means that a 
is balanced. Conversely, if a is balanced, then Aa{^) = ^- ■ 

Lemma 5.3 If a is a monotone, non-projection connective, then any fixed-point of Aa{p) on (0, 1) is either 
irrational or i. 

Proof: By contradiction; without loss of generality assume that the fixed-point Po = ^ < \ and gcd (r, s) = 
1. Hence, 




Multiplying both sides by s^, noting that (5^ = Pk-i = 1> and evaluating the result modulo (s — r)^ yields 

rs'^^^ = /3j ( ^ ) r-^ (s - r)^~^ = + kr^~^{s - r) + (s 
i=o 

= r*-' + A;r'^~^(s - r) mod (s - r)^. 
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Evaluating the left side modulo (s — r)^ yields 



rs 



/A; — 1\ 

+ r{k - l)r^~'^{s - r) +r{s - r)'^'^]^ . jr\s - r) 



= r^ + {k-l)r^ ^(s - r) mod (s - r)^. 

Therefore, 

r''~^{s - r) = mod (s - r)^. 
Since gcd (r, s) = gcd (r, (s — r)^) = 1, r'^~^ ^ mod (s — r)^; this is a contradiction. ■ 

Theorem 5.4 Let a be a monotone unbalanced connective whose characteristic polynomial has a fixed- 
point t € (0, 1), and let the support of fx contain only the projections. The limiting distribution of the growth 
process is concentrated on the threshold function r|-j„-|. 

Proof: Since a is unbalanced and has a fixed-point on (0, 1), by Lemma ls!2l the fixed-point is not i. Hence, 
by Lemma l531 the fixed-point is irrational. Since the fraction of variables set to true in any assignment is by 
definition rational, the fraction will always be strictly greater or strictly less than the fixed-point t. Hence, by 
the standard amplification argument, the limiting distribution will be concentrated on the threshold function 

T\tn'\ ■ ■ 

Theorem l5.4l can easily be modified to cover the cases in which one or both constants are in the support 
of /i. Combining proposition 15 . 1 l and theorem proves the initial claim. 

Theorem 5.5 If a is a monotone unbalanced connective and the support of fi does not contain the negations 
of projections, then the limiting distribution will be concentrated on a threshold function. 

5.1.1 Convergence Bounds 

Except in one case, all these growth processes converge very quickly to their limiting distribution: in 
0(log(n)) iterations. In the exceptional case the convergence requires 0{n^) iterations where k is the arity 
of the connective a; we provide specific criteria that determine whether a process will converge quickly 
or not. There are two main cases: either Aci{p) has a fixed-point, or not. We first derive bounds for the 
latter case, and then for the former. Unless explicitly stated, we assume that constants are not in supp{fi), 
however, the following analysis changes little if constants are in supp{n). 

In the first case, either Aaip) > p for p G (0, 1), and Aa(j)) < p, for p e (0, 1). Since, the two cases 
are symmetric, the same bounds apply to both. Hence, without loss of generality assume that (p) < pon 
the interval (0, 1). 

Lemma 5.6 If a is a monotone connective such that Aa{p) < pon the interval (0, 1) and, Aa{p) has degree 
k > 2 and (3k~i ^ ■^j^^ then for all positive e < = -j^^+i, 



I < A'^il - e) 



Proof: See Appendix. 
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Lemma 5.7 If a is a monotone connective such that Aa{p) < pon the interval (0, 1) and, Aa{p) has degree 
k > 2 and Pk-i = then, for all positive e < k~^, 

1 + e^' < A' ail - e) < (1 - e)''-\k{k - 2)e + 1) 

Proof: See Appendix. ■ 

Lemma 5.8 If a is a monotone connective that is not of the form a{x) = Xj V a'{x), then on the interval 

(0,1), A„(p)<((^) + iy. 

Proof: See Appendix. ■ 

Theorem 5.9 Let a be a k-adic monotone connective such that A^^p) < p on the interval (0, 1), k > 2 
and Pk-2 ^ ■^j^- There exists a constant Ca, such that for alln>0,ifi>3 log(n) + Ca, then for all f, 

ki(/)-vr(/)l <2-" 

Proof: Let fi be a random variable with the distribution vTj. Using an argument similar to Valiant's IVal84l . 
we claim that if i > 31og(n) + Ca, then for |x| = n, P[fi{x) = 0] = 0, and for all x such that |x| < n, 
P[fi{x) = 1] < 2^^". The former follows from the monotonicity of a; regardless of the number of 
iterations, a false negative will never occur. 

In the latter case, assuming that all variables are independent, if |x| < n, then P[/o(x) = 1] = \x\/n < 
1 — n~^. For i > 0, P[fi{x) = 1] = vl^(p), where denotes the ith composition of Aa with itself. 
Expanding Aa{p) around 1, 

A^ip) = A^{1) + A'a{l){p - 1) + 0{{p - If), 

yields: 

Aa{l-e) = l-eA'M) + 0{e^). 
From Lemma l531 let 7 = 35/24 and let = -j^^+i- There exists an eo < such that for all e < eo 

Aa{l-e) < 1 - €7. 

Since P[fo{x) = 1] < 1 - n-\ for i > 21og(n) + 21og(eo) > (log(n) + log(eo))/ log(35/24), 

Ai{l -e) <l-ef <l-eo. 
An additional constant number of iterations, say da, yields 

Ai-{l-eo)<c. 

By Lemma l?^ Aa{p) < k'^p^, thus we fix c < 1^ and let j = log(n) + 1. Hence, 

Ai^{c) < {ecf < 2-2' = 2-2". 

Therefore, for i > 31og(n) + 21og(eo) + da + I and all x such that |x| < n, P[fi{x) = 1] < 2~'^"-, 
implying that - 7r(/)| < 2-". ■ 

Unfortunately, if /3 = convergence takes time polynomial in n. If |x| = n — 1 then P[fo{x) = 
1] = 1 — n-^. Furthermore, by Lemma 15^ for sufficiently large n, A'a{l — n^^) < (1 — n~^)^~'^{k{k — 
2)n-^ + 1). Since 7 < A' a{l - n^^), therefore 

log(7) < (A; - 2) log(l - n-^) + log(A:(A; - 2)n-^ + 1), 
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implying that 



log(7)-^ > {{k - 2) log(l - n-i) + log{kik - 2)n-i + 1)) ' > _ ^ ^ + 0(1). 

Thus, if — n^^) < 1 — eo, then for sufficiently large n, AI^{1 — n~^) < eo implies that i > {k — l){k — 
2)2n(log(n)+log(eo)). In fact, this is the best case. If a(x) = vf^2(^i'^^j)' then ^^(p) = p—p{l—p)^^^. 
By Lemma l5^ 7 < 1 + 'n?~^{k — 1 — kn^^), implying that log(7) < log(l + n'^~^{k — 1 — kn^^)), and 



log(7)-^ > (log(l + n^-^{k - 1 - kn-^))j ^ > 



2 

k-l 



Thus, if A\{1 — n^^) < 1 — eg, then for sufficiently large n, i > ^j^{log{n) + log(eo)). Consequently, 
connectives whose characteristic polynomial has no fixed-point can be classified as either quickly converging 
or slowly converging, with the value of the second last coefficient, (3k-i, determining rate of convergence! 

When the characteristic polynomial Aa{p) does have a fixed-point on the interval (0, 1), a similar anal- 
ysis is used. 

Lemma 5.10 Let Aa(p) be the characteristic polynomial of any k-adic monotone connective. If Aa{p) has 
a fixed-point s G (0, 1), then A' a{s) > 1 + 

Proof: See Appendix. ■ 

Theorem5.il Let a be a k-adic monotone connective such that Aa{s) = s £ (0,1). There exists a 
constant Ca, such that for all n > 0, ifi > k2^ log(n) + Ca, then for all functions f, |vrj(/) — 7r(/) | < 2"". 

Proof: Let /j be a random variable with the distribution vTj. Using an argument similar to Valiant's IVal84l . 
we claim that if i > k2^ log(n) + Ca then for all x such that \x\ < sn, P[fi{x) = 1] < 2~^", and for all x 
such that |x| > sn, P[fi{x) = 0] < 2~^". We first argue the former. 

Assuming that all variables are independent, if \x\ < sn, then P[/o(x) = 1] < s — n~^ea{n), where 
^ain) = miiijgz I'S — ^1 = \s — Since s is an algebraic of degree k, by Liouville's Approximation 
Theorem [Apo97| 



in 



Jo 

s 

n 



n'^ 



where the constant Cq, depends only on the connective. 

For i > 0, P[fi{x) = 1] = A^^{p), where A^^ denotes the ith composition of A^ with itself. Expanding 
Aa{p) around s, 

A^{p) = A^{s) + A'„(s)(p -s) + 0{{p - sf), 

yields: 

A^{s - e) = s - eA' ^{s) + 0{e^). 

By Lemma 15.101 fix 7 = 1 + 2^^^'+^; there exists an eo such that for all e < eo, Aa{s — e) < s — e'y. Since 
P[fo{x) = 1] <s-n'ha{n),if 

i > log(n e„(n)^^eo)/log(7) > log(n^'+^e^^eo)/ log(7), 

then 

Al^{s - e) < s - eY < s - eo- 
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An additional constant number of iterations, say da, yields 

Ai"{s-€o) < c; 

By Lemma lS^ ^a(p) < k'^p^, thus, we fix c < ^ and let j = log(n) + 1. Hence, 

Ai{c) < {k^cf < 2-2^ = 2-2". 

Therefore, if 

i > A:2^ log(n) + + d„ + 1, 

log (7) 

for all X such that |x| < sn, P[fi{x) = 1] < 2'"^"-. 

By the same argument, if jx| > sn, P[fi{x) = 0] < 2~'^^. Since \x\ > sn, for P[fo{x) = 0] < 
1-s- n-^ea{n), P[fi{x) = 0] = A^ip) = 1 - A„(l - p), and P[/,(x) = 0] = Ai{p), j > 0. Just 
as in the preceding case, the composition of A^ with itself first yields a first order divergence from I — s, 
followed by a second order convergence towards zero. Therefore, |vri(/) — vr(/)[ < 2^". ■ 

To reduce the constant in front of the log term, one solution is to use a non-uniform initial distribution, 
as was done by Valiant LVal84J . 



5.2 Using Balanced Connectives 

In this subsection, it will be convenient to start by assuming that the support of fi contains both constants, 
as well as the projections, and to deal later with the cases in which one or both constants are missing 
from the support of /i. If the connective is balanced, then by Lemma ls!2l its characteristic polynomial has 
a fixed-point of |. If the number n of variables is odd, then the fraction of inputs that are true for any 
assignment is bounded away from i, that is, for any j € {1, 2, .., n + 1}, |i — > 2n+4 ■ Hence, by 
the standard amplification argument, the hmiting distribution will be concentrated on the n-adic majority 
function ■ f^ct, the convergence to the majority function is logarithmic in n; by Theorem 15.111 

if i > k2''log{n) + 0(1), the |7ri(/) - 7r(/)| < 2"". When the number of variables is even, however, 
something completely different happens. 

The family of slice functions, denoted Sm,n and defined by Berkowitz IBer82L are monotone n-adic 
functions that assume the value 1 for all assignments of weight greater than m, assume the value for all 
assignments of weight less than m, and may take on either value for assignments of weight m. Unlike 
other growth processes where the distribution is either concentrated on a single function or is uniform on the 
support of the growth process, the growth processes we are about to deal with have a limiting distribution 

that is uniform on Sn/2,n- This set includes a large number, 2^"/^'', of functions; but according to a result 
of Korshunov fKorSO], includes only a tiny fraction, less than exp — ((„/2+i)^ "^^)' support of the 

growth process, which is the set Ain of all monotone functions. 
Define the n-adic functions 

r 1 \x\ = - f 1 \x\ > - 

" \ 0, otherwise \ 0, otherwise 

Claim 5.12 The Fourier coefficients of the probability distribution vr that is uniform on the slice functions 
in Sn/2.n '^^^ given by 
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Proof: Let c = |cS-,„r^ = 2 ^"/^\ If (/, Xn) = 0, then 

Otherwise let be a singleton such that w < f AXn and let W = {g £ Sii ^ \ 9 > w}. Then 
A(/) = c (-1)^-^'^^ =c J^(-l)^^'''^ + (-1)^-^'^®'"^ =0. 

■ 

We shall need to combine amplification with Fourier methods to obtain our result in this case. The 
following "Restriction Lemma" is the key to doing this. 

Claim 5.13 Let a be a balanced monotone connective. Then if f{x) = 1/or some x with \x\ < n/2, or if 
f{x) = for some x with \x\ > n/2, then limj^oo T^iif) = 0. 
Proof: This follows from Theorem l5.1 II ■ 

Lemma 5.14 (The Restriction Lemma) 

If a is a balanced monotone connective, then for all w € Tn, 

lim Ai(u;) = lim /\i{w A Xn)- 

i— >oo i— >oo 

Proof: We begin with the definition 
then rewrite the equation as 

and consider the restriction of w to the slice ^, that is, w A Xn- Since limj^oo 7ri(t V u) = if u ^ f„, 
limj_^oo \ {w A Xn) can be rewritten as 

limA,(u;AXn) = lim y (-l)<^''"^X">7ri(i;) 



veBn 



lim Y X] V-u) 



I— ►oo 

■ • u<x 



y y (-l)<tvn,«-Axn> iini7r,(tVn) 

t<Xn U<Xn 
t<Xn 

^— ' i— >oo 

t<Xn 

(_;^)(i,«,AXn> lij^ TTi(t\/Vn) 

y lim TT.ityVn). 

^— ' j— >oo 



12 



This, in conjunction with 

lim AiH = lim y y (-l)<*^^''"Vi(tV^x) = y y lim 7r,(t Vu) 

i—>oo j— >oo ^ —^ ^—^ ^—^ i— >oo 

t<Xn U<Xn t<Xn «<Xn 

= y (-l)<*Vt'n,«.) lij^ TTiitVVn) = y (-!)<*'"') (-l)^'^"'"') lim TTiitVVn) 
^—^ i— >oo ^— ' j— >oo 

t<Xn t<Xn 

= (_1)K,'«> ^.(i V = lim Ai(ii; A Xn) 

i— >oo i— >oo 

t<Xn 

yields the identity. ■ 

Hence, all we need to show is that linij^oo \ {w) = for such that < w < Xn- To do this we use 
Savicky's IISavQOI argument, which uses induction on the weight of w together with the recurrence 

k 

Ai+i{w) = '^aj{w)Ai{wy +yi{w) 
i=i 

where 

\t\=j 



2^ 

Since the connective is not linear, this recurrence is much more complicated than the one in proposition l3.ll 
The result is the following proposition. 

Proposition 5.15 Let a be a monotone balanced non-projection connective, n be even and the support of /i 
comprise the projection functions and constants. IfO<'w< Xn, then limj^oo Ai{w) = 0. 
Proof: Let w < Xn and recall equation [l] 

To prove this proposition we need only show that IS.q(vS) = if = 1, and that |Ao(w)| < 1 if [tfj = 2. 
In the first case, since w < Xn, w is true on a single assignment of weight n/2. Hence, {w,Xi) = 1 for 
exactly half the projections, where Xi is the ith projection function. Hence, the projections cancel each other 
out. Similarly, the two constants annihilate one another. Hence, Aq{w) = if \w\ = 1. 

The latter case, \w\ = 2, is only slightly harder. Since the constant is part of the support, there 
will at least one positive contribution, — l^°'"'^7ro(0) = Hence, in order for |Ao(i«)| = 1 all other 

contributions must also be positive, specifically, {w,Xi) = for all x^; by the pigeonhole principle this is 
not possible. Hence, |Ao(il')| < 1 if = 2. Substituting these base cases into Theorem 5.3 of ISav90l 
yields the result. ■ 
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This proposition, together with Claim l5!T2l yields the one of our main results. 



Theorem 5.16 Let a be a monotone balanced non-projection connective, n be even and the support of fi 
comprise the projection functions and constants. Then the limiting distribution is uniform on the functions 

5.2.1 Convergence Bounds 

To bound the convergence within the slice we use a theorem of Savicky IISav95al : the conditions of the 
theorem are verified in Theorem 15 .151 

Theorem 5.17 ((Savicky, 4.8 in IISav95a l|)) If a is balanced and nonlinear, Aq{w) = Ofor every w such 
that \w\ = 1, Aq{w) < 1 for every w such that |w| = 2, and there exists a w such that {wl = 2 and 
Ao{w) > 0, then 

maxK(/)-vr(/)|=e-^» 

A more explicit bound, in terms of the number of arguments and the arity of the connective, is possible. 
We use a more explicit version of Lemma l5.14l and bound the convergence of the growth processes charac- 
terized by Theorem 5.3 in ISav90l . A corollary of Lemma l5.18l is that the same bound also applies to the 
growth processes on monotone formulas whose limiting distribution is uniform over the slice functions. 

Lemma 5.18 If a is a balanced monotone connective, then for all w G J-n, 

A,{w) = 0{e'') + {-l)'^^-'^^A,{w A xn). 

Proof: See appendix. ■ 

Theorem 5.19 ((Savicky, 5.3 in BSav9(» )) LetO<w e Tn, let a be a k-adic nonlinear balanced connec- 
tive, and assume that the initial distribution is uniform over the projections, negations, and constants. The 

limj^oo Ai{w) = 0. 

Lemma 5.20 Assume that the conditions of Theorem \5.19\ are satisfied and let a = ^jg^^ < 
1 - 2-''. If\w\ = d>2and 

^, = n2''log{a-') + J2p7^T, (3) 
^ log(a 1) 

then \Ai{w)\ < a^-^^bdii), where hd{i) = {1-12 + 2)('=+i)'"', and 62(2) = 1. 
Proof: See appendix. ■ 

Theorem 5.21 Assume that the conditions of Theorem 15. 1 91 are satisfied, let a be as in Lemma \5.20\ and let 



I = n2'' logia'') + 



log(a-i] 

For any positive c < 1, if w ^ and 



. ^ log(c , log z- J + 2 , ,,2" , r M^ 
log (a) log (a 1 



then \Ai{w)\ < c. 
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Proof: By Lemma 15.201 the coefficient of weigfit 2" lias the greatest converging bound: 

lAi+iHl < a*-^2"(z-n2^'log(a-i) + 2)('^+i)'" 

where 

t:^ log(a ^) 



log(a-i) 

a*-^2" (i - n2'= log(a-i) + 2)(^-+i)'" < c 



Solving for i in the inequality 

completes the proof. ■ 
Thus, by equation |2l 

^^(5) = ^ J] (-1)<^'^>A,(/) 

< ^+ max IAi(/)[, 
2^ /e:?=-„\o 

implying that for all g £ Tn, ^(f?) — 'T^i{^g)\ < c if i satisfies equation|3] 
5.2.2 Varying the Initial Distribution 

Theorem 15.151 can easily be modified to cover the cases in which one of the constants is missing from 
the support of /i: in these cases there is concentration on a single function when n is even and uniform 
distribution on a set of slice functions when n is odd. When the support of consists only of the projection 
functions, however, the situation can be more complicated. If a is not self-dual or n is odd, the result is the 
same as when both constants are present. If a is self-dual and n is even, however, the result is given by the 
following theorem. 

Theorem 5.22 Let a he a monotone self-dual non-projection connective, n be even and the support of /i 
comprise the projection functions. Then the limiting distribution is uniform on the self-dual functions in 

Proof: Same as theorem HTTl ■ 

We note that there are 2 ^ self-dual functions in 5„/2,ra- According to a result of Sapozhenko |Sap89 |, 
this is only a tiny fraction, less than exp -((„/2+i)2""/^~^), of the support of the growth process, which is 
the set of self-dual monotone functions. 
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6 Growing Other Functions 



We can use the same method to analyze other growth processes. For example, the uniform distribution on 
the set of bi-preserving functions (that is, those functions satisfying /(O, . . . , 0) = and /(I, . . . , 1) = 1) 
can be generated by a growth process that uses the bi-preserving selection connective a{x, y, z) = xyM xz 
and an initial distribution that is uniform on the projection functions. The same technique as in the monotone 
case is sufficient to prove this; the corresponding restriction lemma yields the identity 

lim Ai{w) = (-l)<'"'''">A(it; A k„) 

i— >oo 

where rjn = /\^=iXj and k„ = y^^^Xj A'^j=i^i- Similar analysis for the 0-preserving and 1 -preserving 
functions follows easily. 

7 Conclusion 

In this paper we have developed techniques for analyzing growth processes when the limiting distribution 
is uniform over a set of Boolean functions. In particular, we can deal with situations in which this set 
comprises neither a single function nor all Boolean functions. 

We believe that straightforward extensions of the techniques used here will yield a classification of all 
situations leading to uniform distributions over sets of functions. The step that remains to be taken is the 
classification of all sets of functions that can be computed by formulas that are complete A;-ary trees built 
from a single connective. There is some work by Kudryavtsev IKud60b[ IKud60all on this problem, but it 
stops short of a complete classification. 

A more adventurous direction for further work is to deal with situations leading to non-uniform distribu- 
tions. Empirical computations show that these situations can be quite complicated, and we are not yet able 
to formulate a conjecture that covers all our data. 
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A Proofs of Lemmas g^l 1121 Hill ISJOl and gH 

Fact A.l If a is a monotone connective, then: 

1. Aaip) > p on the interval (0, 1) if and only if a{x) = V a'(x) if and only if (3i > 0. 

2. Pk-i = |, aG {0,l,...,fc-l}. 

3. (3o = and (3^ = 1- 

4. Aa{s) = s G (0, 1) if and only if Aa{p) < p, p € (0, s) and Aa{p) > p, p € {s, 1) if and only if 
A'a{0) = A'ail) = if and only if (5o = /3i = and jSk = jSk-i = 1. 

A.l Proof of Lemma 15.61 
Proof: Begin by differentiating Aa{p) 

= kp'-' + Pk-ikp'-\k -kp-l)-Y,P^ Op'-'a - pf-'-\pk - i), 
and evaluate at 1 — e 

A'M - 6) = kil - e)''-\l - e + Pk-ike - Pk-i) " E i ) " - i - ke) 

> kil - e)^-2(l - 6 + Pk-ike - (3k-i) " E J " ^)'"' (^)'"'"'^ 

i=o 

> k{l - ef-\l - e + (3k-ike - fik-i) " E J (^)'"'"'^ 

i=o ^ * ^ 

= k{l-ef-\l-e + I3k-ike - f5k-i) -keJ2(^^ (^) (e)'"*"' 

i=o 

> k{l - e)'=-2(l - 6 + Pk-ike - Pk-i) -keY, Q) 



1=0 

> k{l-ef-^{l-e+^^^{ke-l))-kt2 

k 

= {1 - e)^-\2 + ke{k - 3)) - ke2K 
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For k > 2 and e < e^, 

A'a{l-e) = {l-e)''-^{2 + ke{k-3))-ke2'' 
> (1 - e)'^-\2 + keik - 3)) - I 

35 
24 



A.2 Proof of Lemma 

Proof: For the lower bound, observe that since 

A'^ip) = kp'^-' -Y^f3J%^-\l-pf-^-\pk - i), 

for all p > 1 — k~^, minimizing A'a{p), maximizes the coefficients f3i, for alH = 2 . . .k — 2. Since the 
connective is of the form a{x) = xj A a'{x), Pi < [''^^) [f) = Hence, 

A'o.{v) > kp"'' - E ~ ^)p"\l-p)''-'-Hpk -i) = l + {l-pf-\kp - 1). 
i=o ^ ^ ^ 

Thus, for all e < k~^ 

A'c.{l - e) > 1 + (^~'^{k -l-ke)>l + e^~^ > 1 + 
For the upper bound we minimize all /Jj for i = 2 . . . /c — 2, i.e., /3j = 0. Thus, for all p > 1 — A;^^, 
A'^{p) < kp^-^ -{k- l)p^~^{pk -k + l)= p^-'^{k{k -2){l-p) + 1), 
implying that for all e < A;~^, 

^'a(l-e) < {l-ef-^{k{k-2)e + l). 



A.3 Proof of Lemma 15.81 

Proof: Since a is not of the form a{x) = XiV a'{x), the first two coefficient of Aa are Po = Pi = 0. Thus, 
on the interval (0, 1), 

Aaip) = P2Qp' + Bip)p^ < Qp' + B{p)p' < (Q) 

since B{p) < 1 on the interval (0, 1). ■ 
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A.4 Proof of Lemma ISlOl 

Proof: Consider a projection connective, say x{x) = xi^, b G The corresponding characteristic 

polynomial is 

Axip) =p=p'+p{i- pf-^ + E 7 - 

whose fixed-point is everywhere and whose slope is 1. Note that /3i = 1 and I3k-i = Let 

r/(x) = ^^i^2Xi \l V*L2(a^i A Xi), 
be a fc-adic monotone connective. The corresponding characteristic polynomial 

A^{p) = p - p{l - pf~^ + p^-\l - p) 

= A^{p)-p{l-pf~^+p^-\l-p) 



has a fixed-point at i. Not surprisingly, this is almost A^{p) except that /?i = and (3k-i = 1> i-C-, the 
difference is just two terms. We claim that A'.^{}-) ^ A' a{s). 

The claim is proved by contradiction. Assume that A'n{\) is not the minimum slope at a fixed-point, 
then there exists a /c-adic monotone connective C,, whose degree k characteristic polynomial Aq{p) has a 
fixed-point t € (0, 1), such that A'^(t) < A'^(i). Since /3i = and = 1 must hold for A^, we write 
A^{p) in a manner similar to A^(p): A^(p) = A^(p) + (A^(j») — yl^(p)). Specifically we are interested in 
the differences between Aq{p) and A^(p). In fact, 

Ai^{p) = Ar,{p)+[p'''{l-pf~''' +p''{l-pf 

- pi'' {I - pf-i'' + p'i(l - pf~i' . . . 



where ii < < A; - 2 and > ji+i > 2. 

Since A(^{p) ^ Aj^{p), and A(;(p) has a fixed-point on (0, 1), either zq or jo must exist. Without loss of 
generality assume that io exists and consider the characteristic polynomial As{p) = A^(p) — — 
Since the connective corresponding to A(^{p) is monotone, Jq < kt < iq. which implies that the derivative 
— p)'^~*o-i^2o — kp) of the term — p)^~^c is positive for all u < t. Since the fixed-point u of 
^^(p) is in the interval {^,t), A's{u) < A'(^{t), which is a contradiction! In fact, iteratively subtracting the 
terms p'' (1 — p)^~^'- and adding the terms pJ'' ( 1 — p)'^~ii , reduces A^ {p) to A^ (p) ! . 

Evaluating A'^(^) = 1 + completes the proof. ■ 

A.5 Proof of Lemma 15.181 

Proof: Following the proof Lemma l5. 14l begin with the definition 



and rewrite the equation as 



V&B„ t<Xn u<x^ 
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Consider the restriction of w to the slice ^, that is, w A Xn- By Theorem 15.111 after 0(log(n)) iterations 
7rj(t V n) = 0(e^'), if n / Vn- Hence, for i > 0(log(n)), Ai{w A Xn) can be rewritten as 

A,{wAXn) = 5^ (-l)<'''"'^^">7r,(t;) 

veBn 

n 

*<Xn t<Xn "<XTr,'"^»Jn 

= 5^ (-1) '""'^"^ vr, (t V t;„) + ^ Yl 0{e^^) 

t<Xn t<Xn U<X^,U^V„ 

= 0{e^')+ 7ri(tVt;„). 

t<Xn 

This, in conjunction with 

t<Xn M<X 

= ^(-l)(*v^>-«')^,(^v^;„)+ ^ J] (-l)<*^-'-)7r,(tVn) 

t<Xn t<Xn U<X^,U=iVn 

t<Xn t<Xn U<Xn,UJ^Vn 

= 0{e^') + J] (-l)(*.->vri(t V 

= 0(e2") + (-l)<""'"'>A,(«;AXn) 

yields the identity. ■ 

B Proof of Lemma 15:201 

Lemma B.l ((Savicky, 1990, Lemma 5.1 in | Sav901)) 

Let = J2'j=i'^j^i' ^^'^^ f^^f kol < 1> J2'j=i Wj\ — 1' '^"'^ 1*^11 < 1- 7"/^^'^ l^^j+il ^ where 
a < + |a^o|(l — Hence, \xi\ < a*|xo|. 

Lemma B.2 ((Savicky, 1990, Lemma 4.7 in |Sav90l)) 

For any k-adic connective a, X^^g^^ 5q,(1)^ = 1, and a is balanced and nonlinear if and only if Sa{0) = 
andforalls € B/., \Sa{s)\ < 1. 

Lemma B.3 Let a be a balanced nonlinear k-adic connective and let\w\ = 2. For any positive c < 1, if 

i > log(c"^)n2'', 

then \Ai{'w)\ < c. 
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Proof: By Theorem 5.3 in ISav90ll . 

k 

= ^aj(w;)Aj_i(u;y, 
i=i 

where 

\t\=j |tl=j 

By corollary iB.ll |Aj(u;)| < a*|Ao(tf)|, where a < \ai{w) + Ao(tf)(l — ai{w)). By Theorem 5.3 
in ISav9()l . Ao{w) < hence, 

n — 1 2 

a < |ai(if)H —{l-ai{w)) = 1 — (1 - ai(t(;)), 

n + 1 n + 1 

and since ai(zi;) < 1 — 2~^, 

2 

a < 1 



n + 1 

Solving for i in the inequality o*|Ao(w)| < c yields: 

log(c) -log|xo| 



i > 



log(a) 



and substituting for a on the right: 

log (c) - log I xo I log (c) - log I Xo I 



log(a) log (l - 4^2-'= 



< {{n + 1)2^-1 + ^)(log(c-i) + log |xo|) 

< ((n + l)2'^-i + i)log(c-i) 

< n2'=log(c-^) 



Thus, for i > log(c ^)n2'', \A.i{w)\ < c. ■ 
Lemma B.4 ((Savicky, 1990, Lemma 5.2 in BSav90l )) 

Let Xj+i = Vi + Yl^=i (^j^{> ^^ch that \xi\ < 1, and a = Yl^=i Wjl < 1- Then < a\xi \ + yj. 

CoroUary B.5 //y^ <{i-l + 2)'=a*"'+^ < a/or ^omf' k>Oandl>0, then \xi\<{i-l + if+^^a^'^for 
all i > I. 

Proof: By Lemma < a\xi \ + yj. Hence, by induction on i 

\xi+i\ < a'{\xi\ + {i-l + 2)''a') 

< a'-' + ^(i - / + 2)^ 

< a^-'(i-/ + 2)^'+i 
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B.l Proof of Lemma lSHOl 

Proof: The proof is by induction on j. By Theorem 5.3 in ISav90l . 

k 

where 

{t£Bk: \t\=j} {teBk-. \t\=j} 

and 

veGt \aeBn\wia)=l J \j=l 

where = {v e \ < v < w}. 

Since J2teB^, •S'a(l)^ = 1 and |5„(s)| < 1 for all s € B/,, 

k k 

J=l j=lteBk:\t\=j 

< < E^-w' = i' 

The base case, d = 2, is proved by Lemma lBJ) For the base case, d = 3, we first bound yi{w). By Theorem 
5.3 in l,Sav901 . Aj(w) = if = 1 and by Lemma Ib31 Aj(t(;) < a*-"^* log(a-i) ^ 2. Hence, for 

dX\w^ G^, then /\i{w) < a»-"2' iog(c'-'). if we let ^2 = n2''log(a~i) then A,(w) < a'-'^b2{i) and, 

= E f n (n^«(^i) 

vGG* \aGB„|w)(a)=l / \j=l 

E n^^(-.-) 

veG£, j=i 



< 



Solving for i the inequality 



(2'^a*-^'^-i6rf_i(i)) < 



k 

a 
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yields 

— - — Vk + id^i < - — -, — 7^ + id-i = td < I, 

log(a-i) log(a-i) 

which equals to equation |3] when evaluated at d = 3. Hence, for i > id 

and by Lemma and Corollary IB.5l we complete the base case: 

\Ai+i{w)\ < a\Ai{'w)\ + Viiw) 



< a\A,{w)\ + a'~'''bd-i{i) 



k 



< a'-'''{i-id + 2) 

< a'-'''ii-i2 + 2) 
= a'-'^hd{i). 

Assume that the hypothesis holds for all w of weight less than some fixed d and l&t \w\ = d. Repeating 
the above calculations in terms of d we get an identical bound for yi{w) 

Viiw) < (2''a'-'-^-^bd-i{i)f < bd-i{i)''a'-''' <a, 
where, by the inductive hypothesis, 

{k + l^d 

id — -j 7 TV + 

log (a ^) 

log(a ^) f-' log(a ^) 

= „2'log(a-') + 5:i^±^ 
^ log(a 1) 
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and hence 

|Ai+iH| < a\Ai{w)\ + Viiw) 

< a\\{w)\ + a'-'^bd-iii)" 

\ j=id 



completing inductive step. 



< a'-''' 1 + ^(i-i2 + 2)M' 



= a'-^'^(z-Z2 + 2)('=+^)'"' 
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